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Abstract 

In this paper, the average coset weight distribution (ACWD) of struc- 
tured ensembles of LDPC (Low-density Parity-Check) matrix, which is 
called combined ensembles, is discussed. A combined ensemble is com- 
posed of a set of simpler ensembles such as a regular bipartite ensem- 
ble. Two classes of combined ensembles have prime importance; a stacked 
ensemble and a concatenated ensemble, which consists of set of stacked 
matrices and concatenated matrices, respectively. The ACWD formulas 
of these ensembles is shown in this paper. Such formulas are key tools to 
evaluate the ACWD of a complex combined ensemble. From the ACWD 
of an ensemble, we can obtain some detailed properties of a code (e.g., 
weight of coset leaders) which is not available from an average weight dis- 
tribution. Moreover, it is shown that the analysis based on the ACWD is 
indispensable to evaluate the average weight distribution of some classes 
of combined ensembles. 



1 Introduction 

Ensemble analysis on weight distributions of low-density parity-check (LDPC) 
codes gives us insights on properties of an instance of the ensemble. For example, 
by using the ML-performance bound presented by Miller and Burshtein , we 
can derive an ML-performance bound from the average weight distribution of 
an ensemble. The typical minimum distance 0] can be also derived from an 
average weight distribution. 

The first work on the average weight distribution of a regular LDPC code 
ensemble has been made by Gallager [3]. Recently, Litsyn and Shevelev 0, 
[S] presented the average weight distribution of several regular/irregular LDPC 
code ensembles and their asymptotic behaviors. Burshtein and Miller 1 showed 
methods for asymptotic enumeration and have derived the average weight distri- 
bution of some irregular LDPC ensembles using their technique. Di, Richardson, 
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and Urbanke [2] showed that the saddle point method is useful to derive the 
asymptotic growth rate of an average weight distribution. 

The average coset weight distribution (ACWD) of the Gallager ensemble has 
been introduced by the author CHI an d the ACWD formulas of the Gallager 
ensemble has been derived. These papers show that the ACWD of an ensemble 
indicates some detailed properties of a code (e.g., weight of coset leaders) which 
is not available from an average weight distribution. 

Structured LDPC codes are known to be a promising class of codes which 
attains excellent trade-offs between decoding complexity versus decoding perfor- 
mance. An instance of a structured LDPC code can be regarded as a regular or 
an irregular LDPC code with additional constraints on edge connections. This 
class of LDPC codes includes some well known codes such as repeat accumulate 
codes (RA code) 0, irregular repeat and accumulate codes (IRA code) [B], and 
multi-edge type LDPC codes etc.. 

For design and analysis of structured LDPC codes, knowledge on the aver- 
age weight distribution and the ACWD is desirable. For example, the typical 
minimum distance may be used to optimize the structure of a code. In this 
paper, we discuss ACWDs of some classes of structured LDPC codes. Precisely 
speaking, our main focus is on ensembles of combined matrices, which is called 
combined ensemble. A party check matrix of a structured LDPC codes can be 
considered as a combined matrix. A combined ensemble is composed of a set 
of simpler ensembles such as a regular bipartite ensemble. Two classes of com- 
bined ensemble have prime importance; a stacked ensemble and a concatenated 
ensemble, which consists of a set of stacked matrices and concatenated matri- 
ces, respectively. The ACWD formulas of these ensembles will be derived in 
this paper. Such formulas are key tools to evaluate the ACWD of a complex 
combined ensemble. 

The organization of the paper is as follows. Section [2] gives basic notations 
used throughout the paper and presents some known results on the ACWD of 
several ensembles. Section [21 shows symmetric properties of an ensemble which 
are required for the analysis of a combined ensemble. Section ^ presents the 
ACWD formulas for combined ensembles. In Section [S] asymptotic behaviors 
of the ACWD and the typical coset weight are discussed. 

2 Preliminaries 

In this section, we will briefly review the definition of the ACWD according to 
[Tl) [T^l and some known results. 

2.1 Average coset weight distributions 

Let n and m be positive integers, which are called the column size and the row 
size, respectively. For a given binary m x n parity check matrix H and a vector 
s G F™ (F2 is the Galois field with two elements), the set C(H, s) is defined by 
{x e F£ : _ffx* = s}, which is called the coset corresponding to s (s is called a 
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syndrome). The definition of the coset is slightly different from the traditional 
one because the rank of H is not necessarily m. The number of vectors of weight 
w in the set C(H, s) is denoted by A W (H, s): 

A w (H,s) =#{xe^"^ :#x 4 = s}, t»e[0,n], (1) 

where Z^ n ' w ^ denotes the set {z £ i 7 ^ : |z| = w}. In this paper, the size of a set 
A is represented by #A and the Hamming weight of a vector x is denoted by 
|x|. The notation [a, b] denotes the set of consecutive integers from a to b. The 
set of numbers {A W (H, s)}™ =0 is referred to as the coset weight distribution of 
C(H,s). 

We then consider the average of A w (H, s) over an ensemble of parity check 
matrices. For a given ensemble Q of parity check matrices, the ACWD {^4iu(s)}™ =0 
is given by 



Ms) = p(h)a w (h,s) 



Heg 

= E p w E w** = b], (2) 

where I[condition] gives 1 if condition is true; otherwise it gives 0. Throughout 
the paper, we consider the ensembles such that every matrix in the ensemble is 
associated with uniform probability P{H) — 1/(#Q). By changing the order of 
the summations, we can simplify the above equation as follows: 

a w (s) = Yl E™ ffz ' = s i 

zeZ <.n.,w) Heg 

^ #{ifEg: gz* = s} 

This equation means that evaluation of ^^(s) is equivalent to enumeration 
of the number of parity check matrices in the set {H € Q : Hz 1 — s}. In this 
paper, when we need to indicate the dependency on an ensemble explicitly, the 
ACWD of an ensemble Q is denoted by ^^(s). 



2.2 Known results on ACWD formulas 

The ACWD formulas of several ensembles of LDPC matrices have been already 
derived ^3] EIJ El- We here review some known results. 

The Gallager ensemble 0J consists of (j, fc)-regular binary matrices where j 
and k denotes the column weight and the row weight of a matrix, respectively. 
The ACWD of the Gallager ensemble has been proved in ^3] |16j . 
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Lemma 1 (ACWD of Gallager ensemble[14 [16 ) Let Q be a Gallager en- 
semble such that any matrix in Q is m x n-binary matrix and (J, k)-regular. The 
ACWD of G is given by 



- □ n (| K m/j)Hsil (^i s,l H ro (4) 



for w e [0,n],s 6 F 2 m . The vector S* G F™ h (i E is sub-syndrome which 

satisfies s = (si,S2, . . . ,Sj). The notation [f(x)] w denotes the coefficient of a 
polynomial f(x) corresponding to x w . The polynomials ctk{x) and (3k(x) are 
defined by 

(l + x) k + (l-x) k 
&k{x) = - (5) 

(1 + x) k - (1 - x) k 

mx) = - , (6) 

which are the weight enumerators of the even and the odd weight codes of length 
fc, respectively. rj 

The main difference between the average weight distribution derived by Gal- 
lager :4 and is the use of the odd weight enumerator 10 . 

The next lemma gives the ACWD of a constant row weight ensemble, which 
is referred to as Ensemble E in [7] . The ensemble consists of all binary matrices 
whose row weight is exactly fc. 

Lemma 2 (ACWD of constant row weight ensemble[16j [15 ) Let Q be 

a constant row weight ensemble such that any matrix in Q is m x n-binary 
matrix and has constant row weight fc. The ACWD of Q is given by 

1 m — | s I r . / , * 1 1sl / Tl 



A w (s) = b(n,k,w)] m -' S| [l- 7 (n,fc, W )] |S| (7) 



for w £ [0, n], s € -F 1 ™, where ^{n, fc, w) is defined by 

A 1 x - I w\ / n — w 



T( „, kM = _ Ly^.j. (s> 

□ 

The ACWD of a regular bipartite graph ensemble (abbreviated as a bipartite 
ensemble) has been implicitly used to prove average weight distribution of IRA 
code ensembles in |2] and tripartite graph ensembles in Since these 

papers do not contain the explicit proof of the next lemma, the next lemma is 
presented with the proof, which is given in Appendix. 

Lemma 3 (ACWD of regular bipartite ensemble[2j [13 ) Let Q be a reg- 
ular bipartite ensemble such that any matrix in Q is m x n-binary matrix and 



4 



corresponds to a (j, k) -regular bipartite graph where j and k denote the vari- 
able node degree and the check node degree, respectively. Note that the equality 
jn = km must be satisfied. The AC WD of Q is given by 



a 



m— |s 

'k 



( 



n 



■) 



A w (s) 




(9) 



w 



forw G [0,n],s G F 2 m . 

(Proof) See Appendix. rj 

3 Symmetric Properties of Ensembles 

In order to deal with combined ensembles introduced in Section 0] we need to 
define some symmetric properties of an ensemble. In this section, two symmetric 
properties of an ensemble will be defined. Then, we will discuss how to extend 
a non-symmetric ensemble to a symmetric one. 

3.1 Column and row symmetric ensembles 

The definition of the column symmetric property is given as follows. 
Definition 1 (Column symmetric property) // the equality 



holds for any s G F 2 m , w G [0,n], zj, G Z^ w \ and z 2 G Z {n > w \ then the 
ensemble Q is column symmetric. rj 

The above definition means that G Q : -Hz* = s} depends only on the 

weight of z if an ensemble Q is column symmetric. From the symmetric property 
of the ensemble ()I0|l , the equation @ can be rewritten into a simpler form: 



if Q is column symmetric. For example, all ensembles discussed in Section 12.21 
are column symmetric. 

An important example of an ensemble which is not column symmetric is a 
single matrix ensemble. Let £(H) be an ensemble which includes m x n binary 
matrix H as an only member. Thus, the probability P{H) = I is assigned 
to H . Such an ensemble £ (H) is called a single matrix ensemble. From this 
definition, it is evident that the equation A w (s) = A w (H,s) holds for a single 
matrix ensemble £{H). In general, £{H) is not column symmetric. 

The row symmetric property, which is defined below, greatly simplifies the 
ensemble analysis presented in Section^ 



#{H G Q : Hz{ =s} = #{H' G Q : H'z\ = s} 



(10) 





(11) 
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Definition 2 (Row symmetric property) If the equality 

#{H eG :H Z = s 1 } = #{H / eg :H / Z = s 2 } (12) 

holds for any z G F 2 ™ ; a G [0,m], Si G £( m ' CT ), and s 2 G Z^ m ' a \ then the 
ensemble g is row symmetric. rj 

From this definition, it is evident that the equation 

#{g G ^ : -Hz* — s 2 } 

= i w (s 2 ) (13) 

holds if |si| = | S2 1 - This equation implies that the ACWD A w (s) depends only 
on the weight of s if an ensemble g is row symmetric. 

For a row symmetric ensemble, we here introduce B w {a){w G [0, n],a G 
[0, m]) which is defined by 

B w (\s\) = A w (s). (14) 

The distribution B w {a) is also called the ACWD of the ensemble. One of 
the advantages of a row symmetric ensemble is that we only need to handle 
(n + l)(m + l)-numbers of B w (a)(a G [0, m], w G [0,n]) instead of (n + l)2 m - 
numbers of A t0 (s)(s G F™,w G [0,n]) when we deal with the ACWD of a row 
symmetric ensemble. 

Example 1 The bipartite ensemble is row symmetric. Thus, the ACWD of 
(j,k)-regular bipartite ensemble can be expressed by 



( nJ ) 

\WJ/ 



3.2 Column shuffled ensemble 



*»(*) = - (15) 



w 



□ 



Assume that g (column size n and row size m) is an ensemble which is not 
column symmetric. The column shuffled ensemble T c (g) is an enlarged ensemble 
based on g, which is defined by 

r c (g) = {p(H):Heg, P en n }, (16) 

where 7r„ is the set of all column permutations for n columns. Thus, #r c (C?) = 
n\#g. We here regard r c as a column shuffling operator which acts on an 
ensemble. The next lemma shows that the column shuffling yields a column 
symmetric ensemble from any ensemble. 



G 



Lemma 4 (Symmetric property of column shuffled ensemble) T C (Q) is 
column symmetric. 

(Proof) For any z\ G F^ and p G 7T n , let z 2 — p(z\). For any s G F™, we fterae 
i/ie following equality: 

#{H G r c (5):i/z 2 = s} = #{# G r c (a):ffp(z 1 ) = s} 

= #{ffer c (g): P (ff)z, =s}. 

TTie second equality follows from the equality Hp(z,i) = p(H)z\. There is one 
to one correspondence between p(H) and H . This fact leads to 

#{H G T c {g) : Hz 2 = s} = #{H' G T C {Q) : H'z 1 = s}. (17) 

This equality is identical to the column symmetric condition given in Definition 
□ □ 
The next lemma indicates that the ACWD is invariant after column shuffling. 



Lemma 5 (ACWD of a column shuffled ensemble) For any s G F™, w G 

[0, n], the equality 

ig--w)(B) = iW(») 



holds. 

(Proof) From the equality 



#{H G T C {G) : Hz 1 = s} = #{#' G G : H'z 1 = s}r 



we have 



= E 

= ^l 6) (s). 



#{g G r c (g) : ffz* = s} 

#r c (<?) 

#{#' G a : H'z 1 = s}n! 



(18) 



(19) 



(20) 



□ 

Example 2 Let H* be an m* x n* binary matrix and M(H* : v) be an m x n 
binary matrix with the form: 



( 



H* 



A 



M(H*,u) = 



H* 



V 



H* J 



(21) 



where v is a positive integer and m = vm* , n — vn* . The v-copies of the matrix 
H* are placed on the main diagonal of M(H* ,v) and the remaining elements 
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in M(H*,is) is set to be zero. The coset weight distribution corresponding to 
M(H*,v) is given by 



A w (M(H*,v),a) = 



Y[A w (H*, Si ) 



.1=1 



(22) 



where s = (81,82, ... , S„) and s% G F™ (i G [1, v]). This equation means that, 
if the coset weight distribution corresponding to H* is known, the coset weight 
distribution A W (M(H* , v), s) can be evaluated by using the generating function 
method. From \2°J^ and Lemma\^ we have the ACWD of the column shuffled 
ensemble T C (£(M(H*, v))): 



A w {s) = 



UA w (H*, Si ) 



(23) 
□ 



3.3 Row shuffled ensemble 

Assume that Q (column size n and row size m) is an ensemble which is not row 
symmetric. The row shuffled ensemble T r (Q) is defined by 



T r (G) = { V (H):H eg, v e^ m }, 



(24) 



where tp m is the set of all row permutations for m rows. Thus, f^T r {Q) = mlffQ. 
The row shuffling converts an ensemble into a row symmetric one. 

Lemma 6 (Symmetric property of a row shuffled ensemble) T r (Q) is row 
symmetric. rj 

Since the proof of the lemma is almost the same as the proof of Lemma [SI it is 
omitted. The next lemma gives the relation between the ACWD of an ensemble 
and that of the row shuffled one. 

Lemma 7 (ACWD of a row shuffled ensemble) The ACWD of a row shuf- 
fled ensemble is expressed by 



(25) 



for a G [0, m] and w G [0, n], 

(Proof) The ACWD of a row shuffled ensemble can be derived in the following 
way: 



Agvw>( B)= £ 



#{g G T r (g) : Hz' = s} 

#r,(5) 
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E 



#U, E ^{lfeg:gz'^(8)} 



v #{ g ^g-hz* = 8 '} 
^ ^ m\#g 

x (m — |s|)!|s|! 

— fm\ 

= E T^V)- (26) 

s ' G Z<™,|s|) \\s\J 

In the above derivation, the second equality follows from the relation rj(H)z t = 
7/(iJz*). By replacing |s| by a, we have the claim of the lemma. rj 

Example 3 Let Q be the Gallager ensemble with column size n and row size 
m. We here consider the row shuffled ensemble T r (Q) and its ACWD. From 
Lemma^and the ACWD of the Gallager ensemble it is easy to derive the 
ACWD ofT c (g): 

m/j m/j . 

a 



&2, . . . , &■* 



B w (a) = —i V---V 

xflk m/3Kbl W^(-)] , (27) 



i=l 

where ( fci h ° b ) denotes a multinomial. rj 

4 Combined Ensembles 

In this section, we discuss ensembles which are composed of several simpler 
ensembles. We call such an ensemble a combined ensemble. Two classes of 
combined ensembles, which are called stacked ensembles and concatenated en- 
sembles, are bases of a complex combined ensemble. 

4.1 Stacked ensemble 

Let A and B be ensembles of m a x n and mj, x n binary matrices, respectively. 
The stacked ensemble based on A and B is defined as follows. 

Definition 3 (Stacked ensemble) The stacked ensemble A/B is defined by 

H a 6 A, H b e B J , (28) 
where each matrix in A/B associates with probability 1/{^A#B). rj 



A/Bt 
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The ensembles A and B are called component ensembles of the stacked ensem- 
ble A/B. In the following, for simplicity, we shall denote a stacked matrix as 
[H a /H b ]. The definition of the stack ensemble can be naturally extended to the 
case where the number of component ensembles is more than two. For example, 

we define A/B/C= (A/B)/C. 

The next theorem shows the relation between the ACWD of a stacked en- 
semble and the ACWDs of its component ensembles. 

Theorem 1 (ACWD of a stacked ensemble) If the ensemble B are column 
symmetric, the ACWD of the stacked ensemble A/B is given by 

AL A/B) (s) = j^Ai A \s a )AW( Sb ), (29) 

where s = (s Q , s b ) , s a G F™ a , s fc G F™ b , w G [0, n] . 

(Proof) From the definition of the stacked ensemble, we have 

X(A/B) M _ #{g € A/B : Hz* = s} 

W 

v #{[Ha/H b ] G A/B : [Hg/Hb]^ = [s a /s b ]} 
^ #{A/B) 

where s a and Sfc are binary m a and m b tuples satisfying s = (s a ,s b ). We can 
further rewrite the above equation into the following form: 

a[ a/b) (s) = ^2 ^^ Ha e — : HaZt = Sa ^ 



#{F 6 G B : H b rf = Sfc} 



#B 

#{i?b G B : fffcz* = Sfc} 



#23 \w 



= T^^W^fo)- (30) 

To derive the third equality from the second equality, the column symmetric 
property of B is used. rj 

From the proof of Theorem^ it is evident that A/B is column symmetric if 
both A and B are column symmetric. However, in general, A/B is not necessar- 
ily row symmetric even if both A and B are row symmetric. The row symmetric 
property can be achieved by using row shuffling. 

Corollary 1 (Stacked ensemble with row shuffling) If two ensembles A 
and B are column and row symmetric, then T r (A/B) is also column and row 
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symmetric. The ACWD ofT r {A/B) is given by 

mm{a,m a } . N 
p(T r (A/B)) ( s_ 1 \ - rn a \( m b 

[> ( n )( m ) ^ \a a J\a-a c 

Xfl^((7 a )BW((7-(7 ) (31) 

/or er £ [0, m] , w G [0, n], where m — m a + mj . 

(Proof) It is evident that T r (A/B) is column and row symmetric. We focus on 
the proof of the A CWD. From Lemma^ and Theorem^ we obtain the following: 



BFrW**H*)= £ -LAW**® 



= e J2 A A Hsa)Ai B Hs b ) 

min{cr,m a } 

= E ' E E AfcVa)AgV6), 

where 

6 = EJ5T (32) 

Applying the row symmetric property to the above equality, we have the claim 
of the lemma. rj 

This corollary can be easily extended to more general cases. Let Ai(i € [1, s]) 
be a column and a row symmetric ensemble with row size rrii and column size 
n. The ACWD of T r (Ai/A 2 / • ■ ■ / A) is given by 

5(r r (^iM 2 /-M,)) (a \ _ 1 



e nra^vo ^) 



,...,tT S ),<T^>0 J— 1 

(y—<y i H ho- s 

for if S [0, n] and a G [0, m] where m = mi + . . . + ?n s . Since the proof of 
is almost the same as that of Corollary [TJ it is omitted. 

4.2 Concatenated ensemble 

Let A and B be ensembles of m x n a and m x rtf, binary matrices, respectively. 
The concatenated ensemble is defined as follows. 
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Definition 4 (Concatenated ensemble) The concatenated ensemble A o B 
is defined by 

AoB = { [H a H b ] : H a eA,H b eB}, (34) 

where a matrix H in AoB has the probability assignment P{H) = 1/(#A#B). 

A concatenated ensemble based on more than two ensembles can be denned as 
well as the case of the stacked ensemble. For example, we define Ao B o C = 
(AoB)oC. 

The next theorem presents the ACWD of a concatenated ensemble. 

Theorem 2 (ACWD of a concatenated ensemble) The ACWD of a con- 
catenated ensemble A^ 013 ^ (s) is given by 

min{u;,n a } 

AL A ° B) (s)= E Ai A J(s a )Ai B l w Js + s a ) (35) 

w a — max{0,wi- nt} SaG-FJ 71 

for s G F™ and w £ [0, n], where n = n a + n b . 
(Proof) Let 

L a ( Sl , Zl ) = #{H a :H a eA,H a z\ = si} (36) 
L b {s 2 ,z 2 ) = #{H b :H b eB,H b z 2 = s 2 } (37) 

for zi G F£ a , z 2 G F" 2 lb , si, s 2 G F 2 m . For any H a G A, H b G B and z G F 2 " , i/ie 
equality s = [i? a if(,]z = H a z* a + Fl b z\ holds where z = (z a ,z b ). This equality 
leads to the following relation: 

#{HeAoB:Hz t = s}= £ L a (s a , z a )L b (s + s a , z b ). (38) 

-By applying ^38j) to the definition of the ACWD of the concatenated ensemble, 
we have the claim of the theorem as follows. 

IMoB)M-V *{H^AoB:Hzt = s} 

min{w,n a } , . 

w a — max{0,tw — rib} s a£F™ z a £Z( n a' w a) 

E L b (s + s a ,z b ) 

min{u;,n a } 

= E E ^ ) (Sa)i^(s + S a ). 



□ 
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Remark 1 From the above theorem, we can see that the average weight distri- 
bution of a concatenated ensemble is given by 

min{u),n a } 

Al AoB) (0)= E E ^( Sa )I^(s a ). (39) 

w a — max{0,tw — njy] s„£F 2 m 

This means that the ACWD of component ensembles plays a crucial role for 
deriving the average weight distribution of a concatenated ensemble. rj 

Remark 2 In some cases, the weight corresponding to each component ensem- 
ble should be treated separately. For example, when some bits corresponding to a 
component ensemble are punctured, analysis based on a split weight distribution 
is required. Such a distribution is discussed in W$. 

In such a case, it is useful to define a split ACWD. We here do not go into 
the details such as the definition of a split weight distribution but just see the 
split ACWD version of Theorem]^ 

^£S0O= E ^W^(»H). (40) 

□ 

The exponential number of summands (in terms of m) in (|35|l can be reduced 
when A and B are row symmetric. The following corollary deals with such a 
case. 

Corollary 2 (Case of row symmetric component ensembles) If both A 
and B are row symmetric, then A o B is also row symmetric. The ACWD of 
Ao B is given by 

min{w,n a } a m—o 

b^m = E E E 

w a = max {0,w — n t, } ^1— fi2— 

x Btt\ f i 1 +v 2 )Bl B ! Wa (a- P L 1 + f i 2 ). (41) 

(Proof) Suppose that s € F™ is given. Assume that two binary vectors s a — 
(s a i,Sa2, ■ ■ ■ , s am ) and s b = (sbi, Sb2, ■ ■ ■ , Sbm) satisfy s = s a + s 6 . We define 
two index sets in the following way: 

h = {i e [1, m] : s ai ^ s^} (42) 
h = {i G [1, to] : s ai = s bi }- (43) 

Since s = s a + Sf, holds, the size of I\ and I 2 must be |s| and m— \s\, respectively. 

We here define /Xi and [i 2 by /Xi = J2ieh l Sai l> ^ 2 = Sie/ 2 I s " I- Namel U, Ml 
is the Hamming weight of a vector (s a i)«e/i an d M2 is the Hamming weight of 
(s a j)jg7 2 . Note that the equalities |s a | = \x\ + /X2 and \sb\ = |s| — [i\ + fi 2 holds 
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where Mi £ [0, |s|], M2 £ [0, m — |s|]. Consider the size of the set which includes 
all m-tuples corresponding to s, Mi and M2- 

0(s,^i,/i 2 ) = #{s a e : \s a \ = M1+M2, 

|s + s Q | = |s| -/zi +/i 2 } (44) 

where s 6 F™ , [ii € [0, |s|], /i2 £ [0,m — |s|]. Based on a simple combinatorial 
argument, we have 

From Theorem\^and the above discussion, the ACWD ofAoB can be written 
into the following form: 

min{w ,n a } 

Al A ° B) (s)= E E B^(\s a \)Bi B l Wa (\s + s a \) 

w a — max { , w — n & } s a €:F™ 

m.in{w ,n a } |s| m— |sj 

= E EE ^( s >Mi)M2) 

ii; a — max{0,w — n;,} Mi— M2— 

x i^( M i + M2)si 6 ^ a (|s| - Ml + M2) 

min{ii?,n a } |s| m— |s| 

= E EE 

iu a — max{0,if — rit,} Mi— M2— 

x S£f (mi + ^ 2 )B { w B l Wa (\s\ - mi + M2) (46) 

/or any s £ F^^w G [0,n]. We can see that the right hand side of the above 
equation depends only on the weight of s. This means that A o B is row sym- 
metric. Replacing \s\ by a , we have the claim of the corollary. rj 

Remark 3 If A and B are both row symmetric, then the average weight distri- 
bution of the concatenated ensemble A o B can be derived from Ulf ), which is 
given by 

min{io,n„} m , s 

^ oB) (o)= E E(TKfH^>)- ( 47 ) 

w a — max{0,iu- rib} ^—0 



|s|wm-|s| 
Mi/ V M2 



Related results have been presented in '21 for IRA code ensembles and \lcl\j JhTj 
for tripartite graph ensembles. rj 

Example 4 Let C a be the (j = 2, k = i)-regular bipartite ensemble with column 
size n — 6 and row size m = 3 and Cb be the (j = 1, fc = 2)-regular bipartite 
ensemble with the same column and row size. Table presents the ACWD 
B w {o~) of C a and Cb which are evaluated using f!5p . The ACWDs of the stacked 
ensemble C a /Cb and the concatenated ensemble C a oCb are derived by Corollary 
Q| and Corollary\Q respectively. They are shown in Tables^ and\^ rj 
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Table 1: The AC WD of regular bipartite ensembles 
(a) C a (j = 2, k = 4) 



a\w 



1 



3 



~TB 37 BIT 37 T5~ 

11 11 11 11 11 



16 128 160 128 16 
11 33 33 33 11 




(b) C b (j = l,fc = 2) 



a\w 





1 


2 


3 


4 


5 


6 





1 





3 





3 





1 


1 — 1 





2 





4 





2 





2 








4 





4 








3 











8 












(column size 6, row size 3) 



Table 2: The ACWD of the stacked ensemble C a /C b 



(t\u> 





1 





1 





1 





3 

11 


2 








3 





12 

55 


4 








5 








6 









2 


3 


4 


37 





37 


55 


55 





6 
11 





92 





92 


275 


275 





6 
11 





512 





512 


825 


825 





32 
33 

















11 



12 

55 







1 










(column size 6, row size 6) 



Table 3: The ACWD of the concatenated ensemble C a ° C b 








1 





1 


18 

11 


1 





2 


2 





16 
11 


3 









~TTi 3TT5 

II n" M 



5 


6 


7 


1U84 


1268 


1084 


11 


11 


11 


3292 


3880 


3292 


33 


33 


33 


3272 


3704 


3272 


33 


33 


33 


1064 


1312 


1064 


11 


11 


11 



9 10 11 12 

IF 

li 



"7^ 3TT5 70" 

0,3 TT TT 



100 

li 



li 



866 
33 



344 
11 



1984 
33 



1984 
33 



260 904 ca 
33 33 u 



656 
11 



656 
11 



866 
33 



64 9<M 

U4: 33 



344 
11 



100 
11 

260 
33 
96 
11 



16 
11 



(column size 12, row size 3) 
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In general, a concatenated ensemble A o B is not column symmetric. The 
following corollary is a direct consequence of Corollary and Lemma EJ 

Corollary 3 If both A and B are row symmetric, then the column shuffled 
ensemble T C (A o B) is column and row symmetric. The ACWD b£ c(AoB)) (<t) 
is the same as that given in 

4.3 Combined ensembles 

In the previous subsections, we have seen that an ensemble can be defined based 
on simpler ensembles. A recursive use of stacking operation and concatenation 
operation yields a more complex ensemble. The following definition characterize 
a combined ensemble constructed from simpler ensembles. 

Definition 5 (Combined ensemble) Let Qx, Q 2 , ■ ■ ■ ,Gt be binary matrix en- 
sembles. If an ensemble £ is obtained by combining Q\,...,Qt with stack op- 
eration, concatenation operation, column shuffling, and row shuffling, then £ 
is said to be a combined ensemble. Every ensemble Qi(i £ * s called a 

component ensemble of £ . rj 

4.3.1 Type I combined ensembles 

In principle, the ACWD of a combined ensemble is evaluated by using Theorems 
2] and [21 but we focus on subclasses of combined ensembles whose ACWD can 
be represented by a simple form. 

Definition 6 (Type I combined ensemble) Let £ be a combined ensemble 
expressed as 

£ = Ai o A2 o A 3 o • • • o A s . (48) 

The ensemble Ai(i 6 [1, s]) has column size rii and row size m where n = 
m + 712 + • • • + n s . Each Ai{i £ [1, s]) satisfies the following Conditions CI or 
C2, then the combined ensemble £ is said to be a type I combined ensemble: 

(CI) Ai = T r {Bn/Bi2/ ■ ■ ■ /Bi Ui ) holds where each Bu(£ S [1, itf]) is a column 
and row symmetric ensemble with column size ni and row size ma- Note 
that m = run + 771,2 + ■ • • + TUi Ui must be satisfied. 

(C2) Ai = Bn holds where Bn is a row symmetric ensemble with column size 
ni and row size m. 

□ 

Example 5 Figured presents a configuration of a type I combined ensemble. 

£ = r P (B u /B 12 /Bi 3 ) o T r (B 21 /B 22 /B 23 /B 24 ) o B 31 (49) 
Note that row shuffling operations are omitted in Fig^\ rj 
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1*1 = 3 7i 2 = 4 7/3 = 1 

ni n 2 n 3 



Bn 






B 22 






B 3 i 


B 23 


Bl3 


B 24 





Figure 1: Example of a type I combined ensemble 

The following corollary shows that the ACWD of a type I combined ensemble 
can be obtained based on the recursive use of Corollary |3| 

Corollary 4 (ACWD of Type I combined ensemble) Let 

V = A 1 oA 2 o---oA i - 1 , (50) 
where n a = 71 j an< ^ n b = n i- The ACWD ofD o Ai(i G [2, s]) is given by 

min{w,n a } a rn-a 

B^(a) = E EE 

w a — max{0,iti— rib} Mi— M2— 

x B^(^+^)B^ ) Wa {a- l i l+l i 2 ) 1 (51) 

where Bw\cr) can be obtained by using |3j3J) if Ai = T r (Bn/Bi2/ ■ ■ ■ /Bi Ui ). 
(Proof) The claim of the corollary is a direct consequence of Corollary\^ rj 

Remark 4 Let £ is a type I combined ensemble constructed based on the set 
of component ensembles {Bu}. Corollary^ implies that the ACWD ByP {&) is 
expressed by a linear combination of the terms which have the following form 

nfi^M, (52) 

i=l 1=1 

where uii G [0, nf\ and an £ [0, mu] . A term corresponds to 4 parameters such as 
s, itj, uii and an. Since the number of possible way to choose a set of parameters 
can be bounded by n , the number of the terms in the linear combination is upper 
bounded by n . rj 

The proof of Corollary 0] shows that and Corollary [31 are key tools 
to evaluate the ACWD of a type I combined ensemble. Furthermore, we can 
observe that the number of terms grows with polynomial order 0(n A ). This 
polynomial growth property simplifies the analysis on the asymptotic growth 
rate of the ACWD (discussed in the next section) of a type I combined ensemble. 
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4.3.2 Type II combined ensembles 

A type I combined ensemble is very easy to analyze because every Ai is row 
symmetric. We consider another type of combined ensemble, which includes 
ensembles of multi-edge type LDPC codes. 

Definition 7 (Type II combined ensemble) Let £ be a combined ensemble 
expressed as 

£ = A 2 o A 3 o ■ ■ ■ o A s , (53) 

and each ensemble Ai(i E [1, s]) with column size Hi (n = m + Ti2 + • • • + n s ) 
and row size m satisfies the following Conditions CI ' or C2\ then the combined 
ensemble £ is said to be a type II combined ensemble. 

(CI') Ai = BixjBiij ■ ■ ■ /Bi U holds where each Bu(£ E [1, it]) is a column and 
row symmetric ensemble with column size ni and row size me. Note that 
m = mi + m% + • • • + mi must be satisfied. 

(C2') Ai = Bn holds where Bn is a row symmetric ensemble with column size 
ni and row size m. 

□ 

Example 6 Figured presents a configuration of a type II combined ensemble 
£ = (Bn/B 12 /B 13 ) o (B21/B22/B23) o 631. (54) 

□ 





ni 


n 2 


n 3 


mi 


Bn 


B21 




m 2 


B12 


B22 


B31 


m 3 


Bl3 


B23 





Figure 2: Example of a type II combined ensemble 



Note that, in general, Ai(i E [1, s]) is not row symmetric when A4 = 
Bn/Bi2/ ■ ■ ■ /Bi U . This fact makes analysis more intricate than that of a type I 
combined ensemble. 

Consider the case where Ai = Bn/Bi2/ ■ ■ ■ /Bi U . Each Bail E is a 

column and row symmetric ensemble with column size n and row size mi. From 
Theorem ^ we immediately have the AC WD of Ai : 

^ l) (s) = ttt ^A^\ Sl )A^( S2 )...A^(s u ) (55) 
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where s = (si, . . . , s„) and e F™ e (£ £ [1, w])- From the assumption that Ba 
is row symmetric, it is evident that the ACWD depends on (|si|, | S2 1 , ■ ■ ■ , |s M |); 
namely 

^'(^-^rn^HN). (56) 
\w) e=i 

In order to evaluate the ACWD of a type II combined ensemble, it is natural to 
define the following variant of the ACWD, which is called the ACWD in split 
syndrome form. 

Definition 8 IfAi = B a /B a / ■ ■ ■ /B lu holds, then C^ Ai) (a u . . . ,a u ) is defined 
by 

C^\a 1 ,...,a u )^-^f[B^(a i ), (57) 

\w) t.=l 

where o~i s [0,me] for each I £ [1, w] . If Ai = Bn then, let 

C^{a x , ...,a u ) = B&Jfa + ■■■ + a u ). (58) 

□ 

From this definition and (|56|l . we see that the following equation 

i^)(s)=C^)(|s 1 |,...,|s ll l) (59) 

holds for each i 6 [1, s]. By using the ACWD in split syndrome form, we can 
handle the ACWD of a type II combined ensemble. The following corollary 
explains the details. 

Corollary 5 (ACWD of Type II combined ensemble) Let 

V = A 1 oA 2 o---oA i - 1 , (60) 
where n a = Y^jJi n j an d n b = n i- The ACWD of T> o Ai(i G [2, s]) is given by 

min{uj,n a } a\ m\—<7\ a u m u —(7 u 

c£**W.. E E -E E 

nia=max{0,m-ni} pi=0 qi=0 p u =0 q u =0 

x n (2) ~ ai ) d £ ] (pi + <&. • ■ • .p. + *.) 

X C^l a (ai -pi+qi,...,<J u -p u + q u )- (61) 
(Proof) From Theorem^ we have 

min{uj,n a } 

iL^( S )=E E ^>a)i^t(s + So ) 

SaG-F™ w a — max{0,t(J — n^,} 

min{ tL',n a } 

=E E c^(| Sal |,...,| Sau |) 

SaG-F"™ w a— max{0,«; — rif,} 

x Ct^jlsi + s„i|, . . . , |s u + s QU |), (62) 
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where s — (si, . . . , s u ) and s a — (s a i, . . . , s au ). Based on the arguments similar 
to those used in the proof of Corollary^ A^ ) °' Az \s) can be transformed in such 
a way: 

min {w,n a } 

= E E •• E c£>(\ Sal \,...,\ Sav \) 

to a =max{0,uj-ri(,} s a ieF" 11 s a „S.F™" 

X C^w a (\ Sl + S Ql|) ■ ■ ■ , |s„ + S au |) (63) 
min{u>,n a } |si | mi — |si | \s u \ m u — \s u \ u 

= E E E •"E E n^ s i>^'*) 

to a =max{0,Mi— n b ] Pi=0 qi=0 p u =0 q u =0 j = \ 

^C ( ^J{p 1 +q 1 ,...,p u + q u ) 

x Ci^ a (l s i| -Pi \s u \ -Pu + q u )- (64) 

By replacing \sj\ by Oj(oj e [0,777.^-]) for each j(j £ [l,u]) 7 we obtain the claim 
of the corollary. rj 

5 Asymptotic Growth Rate of the ACWD 

The asymptotic growth rate (abbreviated as the AGR) of an average weight 
distribution of an ensemble reflects the asymptotic behavior of a code included 
in the ensemble. Thus, the AGR of an average weight distribution has been 
extensively studied in |S] PP 0. In this section, we discuss the asymptotic 
growth rate of the ACWD, which means the asymptotic growth rate of A w (s). 
For simplicity, we only focus on the row symmetric ensembles in this section. 

5.1 AGR of a regular bipartite ensemble 

Definition 9 (AGR of the ACWD) Let {G n }n>o be a sequence of row sym- 
metric ensembles. The ensemble Q n has column size n and row size (1 — R)n, 
where R(0 < R < 1) is called the design rate of the ensemble. The asymptotic 
growth rate of the ACWD of {Gn}n>o is defined by 

b e (n) = lim - log 2 B<g">((l - R)nn), (65) 

n— >oc 77, 

where < i < 1 and < n < 1 . rj 

Note that the above definition is consistent with the definition of the asymp- 
totic growth rate of an average weight distribution discussed in [H] 0- 
Namely, 6^(0) is exactly same as the asymptotic growth rate of an average weight 
distribution. 

The saddle point method (Hayman method [2] ^2) is quite useful to esti- 
mate coefficients of a generating function and yields closed form formulas for 



20 



asymptotic growth rate. The next lemma presents the asymptotic growth rate 
of the sequence of the (j, fc)-regular bipartite ensembles. 

Lemma 8 (AGR of bipartite ensembles) Let {Q n }n>o be the sequence of 
the (j, k)-regular bipartite ensembles with design rate R = 1 — j/k. The asymp- 
totic growth rate of this sequence of ensembles is given by 

h(v) = ^((^-v)^og 2 a k (r)+rilog 2 P k (r)-£klog 2 r) 

-(j-l)H(l), (66) 

where r is the smallest positive root of 

«$f-« (67) 
and H(x) is the binary entropy function defined by 

H(x) = -a:log 2 (a;) - (1 - x) log 2 (l - x). (68) 

(Proof) Let 



f{x) = ak {x) l -*[3 k {x)*. (69) 



From Lemma\^ we have 



The asymptotic growth rate bi^n) can be rewritten as follows: 



b t (r)) = hm - log 2 - 



" X " {in') 



\lnj 

= hm -log 2 [f(x)^ n 



n 



tnj 



- hm -log 2 ( /M+lim -log 2 ( " ). (71) 

moon \inj J n—>oan \" n J 



By using the asymptotic approximation of a binomial 



'log^Wf-W), (72) 



n \w 



we have the following equality: 
1 ,„„ ( n A , 1 



n 



■ log 2 / . +- log 2 = -jH{l) + H(t)+o(l) 



-{j- l)H(£)+o{l), (73) 
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where o(l) is the term which converges to zero as n — ► oo. Therefore, the sum of 
the second and the third terms in J7J| ) converges to —(J—1)H(£). The remaining 
task is evaluation of the first term in |7_?| ). By using the Hayman method '21 
\12}/ for evaluating the n-th coefficient of a power of a polynomial, the following 
relation is obtained: 

lim -\og 2 [f(x)^- R >] ijn 

n—>oo n -i 

= lim (1 - R)- — \og 2 [f{x)^ n ] lk{1 _ R)n 

n—too (1 — K)n 

= (1-R) lim -\og 2 [f{x) n ] lkn 
1 f(r) n 

n— *oo n r i^ri 

= (l-i?)(log 2 (/(r))-£fclog 2 r), (74) 

where r is the smallest positive root of xf'(x)/ f(x) — Ik. The claim of the 

□ 



lemma follows from the above results 



Since the asymptotic growth rate of other ensembles can be obtained with sim- 
ilar arguments, we omit the discussion of other ensembles. 

In |16| . a relation between the weight of a syndrome and the coset weight 
(defined in the next subsection) is proved. The relation is called a syndrome 
weight bound in ^B]. A similar bound can be derived for a regular bipartite 
ensemble. 

Lemma 9 (Syndrome weight bound for bipartite ensemble) If I < r\jk 
holds, then bi(jj) = —oo. 

(Proof) The polynomial f(xY 1 ~ RS>n can be expressed as 

/(£)(!-«)« = Cv x v + c v+1 x v+1 + ■■■, (75) 



where f(x) = afc(a;) 1_, '/3fc(x) , '. From the definition of ak(x) and f3k(x), we 
can see that the minimum degree v is equal to r/(l — R)n. It is obvious that 
[f(x)^ 1 ~ R * >Tl }ejn = holds if Ijn < n(l — R)n. The above statement is equivalent 
to the claim of the lemma. rj 

Example 7 Figured shows the AGR bi(n) of (J = 3, k = 6)-regular bipartite 
ensemble. For example, the rightmost curve corresponds to the case where r\ = 1 . 
From Lemma\Q we know 6^(1) = — oo if £ < rj/k = 1/6 ~ 0.1667. From Fig\Q 
we can observe that bg(l) > — oo when t > 1/6. rj 



5.2 AGR of combined ensembles 

The next corollary reveals the relation between the AGR of a concatenated 
ensemble and those of component ensembles. 
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Relative weight I 

The curves in the above figure correspond to bi(rf), n = 0.0, 0.2, 0.4, 0.6, 0.8, 1.0 from 

left to right. 



E 
< 



Figure 3: AGR of (j = 3, k = 6)-regular bipartite ensemble 



Corollary 6 (AGR of concatenated ensembles) Consider two sequences of 

row symmetric ensembles X = {A n }n>o md Y = {£>„}„>o- The ensemble An 
has column size vin(0 < V\ < 1) and row size (1 — R)n and B n has column size 
v 2 n(0 < v 2 < 1) and row size (l~R)n(0 < R < 1). We assume that vi + u 2 = 1- 
The asymptotic growth rate of the sequence of the concatenated ensembles 

Z = {An ° B n }n>o is given by 

~ ( Z) 

°i yi) = „ „ ma ^ -9(^1^2, Ki,k 2 ), (76) 
where g(£i,£ 2 ,Ki,K 2 ) is defined by 

g{ll,h,K 1>K 2) = (l-R) (r 1 H(^)+(l- V )H f " 2 



V J V 1 

+ b' l f ) (K 1 +K 2 )+bZ ) (ll-Kl+K2) (77) 

and £l(t,rf) is the set defined by 

n(l,ri) = {(h,h,K 1 ,K 2 ) : 1= vxh +u 2 £ 2 ,0 < h < 1, 

<l 2 < 1,0 < m < ?7,0 < k 2 < l-ry}. (78) 

(Proof) Let m = (1 — R)n. From Corollary\^ the ACWD of the concatenated 
ensemble A n ° B n is given by 

^"*'H= Y, Q(^1^2,K1,«2), (79) 
(ii,4a,«i,/e2)e« 
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where 

A / ran \ ( m(l — 77) 



\mKiJ \ mK, 2 



Q(£i,e 2 , ki, «2) 

x^imn("»(«i + «a))S^ n (m(tj - «i + k 2 )). (80) 



TTie swm in \79\j can be upper bounded by the product of the number of terms and 
the maximum value of the summands. Since the number of terms are bounded 
by n 3 , we have the following upper bound: 

B^ nOBn \mri) <n 3 max Q(4, h, «i, Ka). (81) 

On the other hand, the sum in \79\j can be lower bounded by any single term. 
Namely, we have 

B^ oB "\rim)> max Q{l x ,l<i, «i, k 2 )- (82) 

(£l,£2,Kl,K2)e£2 

From the upper bound ]81\) and the lower bound \8ty) . we immediately obtain 

-\og 2 B { ^ n ° Bn \rim) = -\og 2 max Q(£i, li, «i, K2) 

+ o(l). (83) 
TTie claim of the corollary is obtained by 

b ( f\v)= lim ilog 2J B^" oBn) (r/m) 

n^oo 77, 

= lim |-log 2 max Q(^i,^a, «i, «a) + o(l" 
= max g(£\,i 2 ,Ki,K 2 ). (84) 

□ 

Remark 5 Based on similar arguments, we can prove the asymptotic coun- 
terparts of Corollary^] for stacked ensembles, Corollary^ for type I combined 
ensembles, and Corollary^ for type II combined ensembles. The essential part 
of such proofs is that the number of terms corresponding to a summation in an 
AC WD formula is polynomial order to n (e.g., Corollary^. Thus, we can re- 
place a summation operator by a max operator to obtain the asymptotic growth 
rate. rj 



5.3 Typical coset weight 

From the ACWD of an ensemble, we can obtain detailed information on an 
instance of the ensemble. We here discuss the weight of the coset leader, which is 
called coset weight. The following discussion is based on the standard argument 
on the typical minimum distance 0]. 
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For a given parity check matrix H and a syndrome s, the coset weight 
D(H,s) is defined by 

D(H,s)= min |x|. (85) 
The accumulated coset weight distribution is defined by 

T 

F T (H,s) = ^2 A w(s,H), re[0,n]. (86) 



From the above definitions, it is clear that D(H, s) < r if F T (H, s) > 1 holds. 

Assume that a syndrome s is given and we will draw a parity check matrix 
from an ensemble according to the assigned probabilities. By using the Markov 
inequality, it can be proved that 

Pr[F T (H,s) > 1] < F T (s), (87) 

where the average of the accumulated coset weight distribution F T (s) is given 
by 



F T (s) = £ P(H)F T (H,s) 

T 

w=0H£Q 

T 

= £A,(s). (88) 

w=Q 

The equality (|87J) means that the probability such that a coset with coset weight 
smaller than r is sampled is upper bounded by F T (s). Namely, evaluation of 
F T (s) brings us information on the coset weight D(H,s). 

For analyzing the asymptotic behavior of F T (s), we introduce the typical 
coset weight in the following way: 

Definition 10 (Typical coset weight) Let b e (r))(0 < £ < 1,0 < t] < 1) be 

the AGR of a given ensemble. The typical coset weight of the ensemble is defined 

by 

9 V > = argmin{f : b e (r}') > 0, < £ < 1} (89) 
for given n'(0 <rf<l). rj 

For example, in the case of a regular bipartite ensemble, 1)89(1 is equivalent to 
9 n t = argminji? : bi(n') = 0, < I < 1}, which is the smallest root of bi(i]') = 0. 
Since we will only deal with a row symmetric ensemble in the following, we 

define G T (\s\,H) = F T (s,H) and G T (|s|) = F T (s). 

The following theorem shows that the probability such that a coset with 
coset weight smaller than l'n(l' < 8 V ) is sampled converges to zero as n goes to 
infinity. 
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Theorem 3 Suppose that £' = 9^ — e, where e is any positive real number 
satisfying I 1 > 0. The equality 

lim Pr[G t > n {H, r)(l - R)n) > 1] = (90) 

n — >oo 

holds for given r)(0 < r\ < 1). 

(Proof) From this definition of n , we can see that bi(r/) < holds for < I < £'. 

In order to evaluate the asymptotic value of Gi' n {rj(l — R)n), we consider 
(1/n) log 2 Ge' n (r/(1 — R)n), which is simplified in such a way: 

-log 2 GW(?7(1 - R)n) 
n 

= \ lo & \Y,B W { V {1- R)n) 

< - log, ( (l'n + 1) mSkB w (ri(l - R)n)) 
n \ w=o J 

t 1 1 

= max-log 2 Bi„(r/(l - R)n) + o(l). 
i=o n 



From the above inequality and the inequality bi(j]) < 0(0 < I < £'), we have 

t' 

< max 6; (ri) 
~ i=o K " 

< 0. (91) 



1 i' ~ 

lim -\og 2 Gi, n {ri{\ - R)n) < maxfy^) 

n— »cxd n 1=0 



This implies 

lim G &n (ri(l - R)n) = 0. (92) 

n — >oo 

The use of the Markov inequality \81\j and this equality leads to the claim of the 
theorem. q 

Example 8 In the case of (3,6)-regular bipartite ensemble, we have 9o.2 — 
0.0788 and #o.8 — 0.146. In general, it is observed that the typical coset weight 
increases as 77 grows (see also Fig\3j). q 
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Appendix 

(Proof of Lemma 01 Consider the socket modelpp for (j, /c)-regular bipartite 
graph ensemble. The symbols j and k denote the variable node degree and 
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the check node degree, respectively. The check node sockets are denoted by 



(ci,C2, . . . , Cj n ) and the variable node sockets are denoted by (ui,i>2, 



v jn ). 



The bipartite graph ensemble consists of all the bipartite graphs constructed 
in the following way: Let 7Tj„ be the set of all permutation on jn elements. 



(ui,u 2 , ■ ■ -u jn ) = ir((v 1 ,v 2 , 



J) A bipartite graph G(7r)(7r g 7r jn ) is ob- 



tained by connecting Ci and Ui(i 6 [1, jn]) with an edge. There is one-to-one 
correspondence between a permutation in wj n and a (J, k) regular bipartite 
graph. Thus the size of Q is equal to {jn)\. 

Assume that w variable nodes corresponds to 1 as their value. The number 
of edges connecting such variable nodes (called active edges) is equal to jw. 
The rest of edges are called inactive edges and the number of inactive edges is 
jn - jw. 

The edge configuration is a binary vector (ei,e2, . . . ,ejn) where e< = 1 if 
the edge from a is active; = otherwise. The number of possible edge 
configuration E(s) which corresponds to a syndrome s is given by 



e( S )= «r N (^i s| w 



WJ 



(93) 



For a given edge configuration, there are (jn— jw)\{jw)\ graphs which yields the 
same configuration. This is because the permutations within the active edges 
and inactive edges do not change the edge configuration. We now use the one- 
to-one correspondence between a graph and matrix. This correspondence leads 
to the claim of the lemma in the following way: 



A w (s) = 



#{H E G : Hz* = s} (n 



(jn)\ 



( nj ) 



(94) 
□ 
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